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SUMMARY AND CONCLUSIONS 



PURPOSE 

This study was part of Work Unit ATC-PERFORM, a project which 
assisted the Army in the review, evaluation, and refinement of 
performance-based training in Army training centers. At the USA 
Armor Center, the work was designed to develop, field test, and 
refine performance-oriented training techniques in the Reconais- 
sance Specialist (MOS IID) and Armor Crewman (MOS HE) Advanced 
Individual Training Programs. 

APPROACH 

Working groups, composed of representatives from the Armor 
Center and HumRRO, in coordination with the Armor School, approach- 
ed the task in four phases: development of task inventories for 
each MOS, development of training objectives for each task, devel- 
opment of performance measures for each objective, and assessment 
of performance-oriented revisions of training content and methods 
for each training program. 

The original task inventories listed all tasks addressed in 
the existing Army Subject Schedules and lesson plans, plus addi- 
tional tasks determined by Armor Center personnel to be appro- 
priate for entry-level performance. Initially, 255 tasks were 
identified for Reconnaissance Specialist (MOS IID) and 242 tasks 
for Armor Crewman (MOS HE) . Following review for entry-level 
requirements, task inventories were reduced to 101 tasks for IID 
and 106 for llE. Training objectives were developed and trans- 
lated into performance measures which were reviewed and re-written 
by subject matter experts. The resulting measures were aggregated 
into 52 performance tests for IID and 63 performance tests for HE. 
The two training programs were revised to include the identified 
training objectives and performance measures. 

The two programs were field tested at the Armor Training 
Center. The IID program was refined through the conduct of success 
ive training cycles for 10 reconnaissance troops, and the HE pro- 
gram was administered to 14 successive cycles of armor companies. 
The approximate numbers of trainees involved were 1,000 and 2,000 
respectively. 

Program assessment consisted of: observation of classes to 
identify where revision of lesson plans was required; administra- 
tion of mid-cycle and end-of -cycle performance examinations; and 
collection of trainee and instructor attitude data. Data from the 
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observations, examinations, and attitude surveys were used in a con- 
tinuing refinement of training content and methods. 

FINDINGS 

1. Conduct of these training R&D activities in an operational 
training setting resulted in continui.ng heavy workloads on trainers, 
high frustration levels, project delay and strecch-ou*:, and a 
significant lessening of the control over input and administrative 
variables that is customarily assumed to characterize rigorous 
research practice. 

2. Performance data and training observation disclosed that 
iterative program refinement over ten successive troop training 
cycles resulted in steady improvement of the IID program (first 
time percent pass rates on mid-cycle tests starting at approximately 
60 percent, increasing to approximately 90 percent; first time per- 
cent pass rates on end-of --cycle tests starting at approximately 80 
percent, increasing to approximately 95-100 percent). 

3. Similar performance data and training observation disclosed 
that intensive efforts to refine the llE program prior to field test 
produced such an effective program that few refinements were requir- 
ed over the course of 14 successive company training cycles (first 
time percent pass rates on mid-cycle tests starting at approximately 
85 percent, increasing to approximately 95 percent; first time per- 
cent pass rates on end-of -cycle tests starting and remaining at 
approximately 90-95 percent throughout) . 

4. Trainees and instructors generally expressed confidence in 
both programs and in the quality of program output. 

CONCLUSIONS 

1. Conducting large-scale training R&D and effecting institu- 
tional change in Army field training operations is arduous and time- 
consuming. Constant monitoring of the system under study, coupled 
with a flexible approach to research design and experimental con- 
trol are essential, if priority operational requirements are not to 
negate the effort. 

2* The incorporation of performance-oriented training concepts 
and techniques into Armor Advanced Individual Training Programs 
produces graduates with demonstrated high levels of skill as entry 
level reconnaissance specialists and armor crewmen. 

3. Such programs are cost/effective in that they can be 
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Implemented without increasing the personnel, time, and facility 
costs of training* 



PREFACE 



HximRBD Work Unit ATC-PERPORM was initiated in 1972 to assist 
the Army in a continuing review, evaluation, and refinement of 

^ performance-based training in Army Training Centers. As part of 

ATC-PERPORM, a study was conducted to develop, field test, and 
assess the effects of performance-oriented revision of the Armor 

r Reconnaissance Specialist and Armor Crewman Advanced Individual 

Training (AIT) Programs at Fort Knox, Kentucky, during FY 73-75. 

Work Unit ATC-PERFORM has been conducted by the HumRKD Western 
Division, of which Dr. Howard H. McFann is Director. Dr. John E. 
Taylor was the Work Unit Leader. The Arncr AIT study was conducted 
successively by Mr. G. Gary Boycan, Mr, J. Patrick Ford, and 
Dr. Douglas L. Young, all of the HumRRO Central Division at Fort 
Knox. Mr. William L. Warnick and Mr. James H. Harris provided 
assistance on the project. Administrative and logistical support 
for the study, as well as assistance by enlisted personnel, were 
provided by the US Army Research Institute Field Unit, commanded 
by Lie Willis Pratt. 

Field support for this study was provided by the First Brigade, 
US Army Armor Center, under the command of COL Hillman Dickinson, 
then COL Rodney D. Renick, and recently COL Philip L. Bolte, whose 
officers and enlisted men contributed greatly in developing and 
refining the performance-oriented training programs. The efforts 
of LTC Gordon L. Stone and the Fifth Cavalry Squadron were particu- 
larly noteworthy for their hard work and professional field test of 
the first revised program. 

HumRRO research on ATC-PERFORM was conducted under nAHC19-73- 
C-0004, under the sponsorship of the US Army Research Institute for 
the Behavioral and Social Sciences, with Dr. Otto Kahn serving as 
the technical monitor. Training research is conducted under Army 
Project 2Q062107A745. 



Meredith P. Crawford 
President 

Human Resources Research Organization 
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BACKGROUND 



During the first phase of the Army's conversion to an all- 
volunteer status, the Experimental Volunteer Army Training Program 
(EVATP) was developed and field tested for Basic Conbat Training 
(BCT) and Advanced Individual Training (AIT) Infantry in January 
1971. This training system identified critical subject skills and 
knowledge, stated course and subject objectives in performance terms, 
prepared performance testa, established "hands on" instructional 
techniques, atid implemented quality control practices. The EVATP 
produced graduates who performed at significantly higher levels than 
graduates of the conventional program.-^ 

TPADOC subsequently directed that all training programs con- 
ducted in Army Training Centers be reviewed and revised. Program 
revisions were to be based upon the results of systems engineering 
of training, performance-oriented training, and other actions having 
implications for such revisions. Performance-oriented instruction 
and testing were to be incorporated wherever feasible and HumRRD 
technical assistance was to be used during revision or redesign of 
instruction. 

Work Unit ATC-PERFORM provided technical R&D assistance to the 
Armor Training Center, Fort Knox, Kentucky, in revising and refin- 
ing two ongoing Advanced Individual Training (AIT) Programs, Recon- 
naissance Specialist (MOS llD) and Armor Crewman (MOS HE) . These 
programs were selected for attention because they train entry-level 
soldiers for critical and high-density armor MOS. 

PURPOSE 

The purpose of the Armor sub-effort of Work Unit ATC -PERFORM 
at Fort Knox was to assist the USA Armor Center in the refinement 
of MDS-related training in the two Armor AIT programs, with partic- 
ular emphasis on performance-based training and testing. These 
courses are conducted by the First Brigade of the Armor Training 
Center under proponency of the Armor School. 

Specifically, the work undertaken was the development of per- 
formance training objectives stated in measurable terms, the trans- 
lation of these objectives into GO/NO-GO tests for assessing 



John E. Taylor, Eugene R. Michaels, and Mark F. Brennan, The 

Concepts of Perfomanoe'-Oriented Instruction Used in Developing -the 
Experimental Volunteer Army Training Program^ HumRRO Technical 
Report 72-7, March 1972. 
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training attainment, and the loodification of training content and 
methods, where appropriate, to incorporate the principles of 
performance-oriented instruction. ^ 

It was proposed to conduct the work in coordination with per- 
sonnel of the Armor School and Training Center. Experimental work 
(data collection, utilization of trainees and cadre, modifications 
in training operations,...) were to be accomplished in the context 
of the First Brigade's ongoing training operations and were not to 
interfere with or interpose obstructions to the continued flow of 
trainees through the training base. 

APPROACH 

Working groups of Armor Center and HumRKD representatives, 
working in coordination with the Armor School, completed the project 
in the following four phases: 

1. Development of a task inventory for each MOS. 

2. Development of training objectives for each task. 

3. Development of performance measures for each objec- 

tive. 

4. Field refinement of performance-oriented revision of 

training methods and content for each program. 

The activities of each phase are described in the following 
sections. 

DEVELOPMENT OF TASK INVENTORIES 

This phase was initiated at the beginning of FY 73 and completed 
during the second quarter. Major problems encountered here were 
with the large number of tasks in each MOS and differences between 
tasks of the MOS, The Training Center Project Officer, Assistant 
S-3 (llE), Assistant S-3 (IID) , NCO instructors, and HumRBD repre- 
sentatives reviewed the Army Subject Schedules and lesson plans to 
identify the tasks currently addressed in training. 

The officers and senior NCOs in the working group added to these 
lists tasks which their experience and the results of systems engi- 
neering indicated to be required of an entry-level MDS incumbent in 
an armor or reconnaissance unit. 



See TKADOC Pamphlet 600-11, "Guidelines for the Conduct of 
Performance Oriented Training," 22 October 1973. 
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The group then coded each task to indicate which of the follow- 
ing levels of proficiency was required of an incumbent: 



As a final step, the task lists were screened to identify those 
tasks most critical for an entry-level soldier which could be taught 
within the time and equipment constraints imposed upon the AIT pro- 
grams. 

DEVELOPMENT OF TRAINING OBJECTIVES 

Late in the second quarter of FY 73, the working group under- 
took the development of performance objectives and standards to 
define entry-level requirements for the selected tasks. Work on 
this phase extended into the first quarter of FY 74. 

The objective prepared for each task explicitly stated the 
behavior to be performed, the task performance conditions, and the 
performance standard(s) • Behaviors expected of trainees were 
briefly described in performance terms. Conditions of performance 
were described by stating the circumstances under which the tasks 
must be performed. Standards stated the steps required for task 
performance and the time limitiitions (when appropriate) within which 
the tasks must be successfully performed. When time limits were not 
specified in published doctrine, the subject-matter experts on the 
working group derived from their experience reasonable times for 
entry-level task performance under the stated conditions. 



Work on performance measures and tests was started in the 
fourth quarter of FY 73 and completed in the second quarter of FY 74. 
The working group translated the training objectives for each task 
into GO/NO-GO test items. Performance conditions were described in 
detail to enable test administrators to construct the test environ- 
ment in a way that would approximate the job context as closely as 
possible. 

To facilitate test administration, items for related objectives 
were grouped into tests, suitable for publication as a pocket-size 
book. The book could then serve to facilitate training and job 
performance. 



1. 
2. 
3. 
4. 



Completely qualified. 

Able to perform complete task under some conditions. 
Knows about task procedure. 
Basic orientation awareness. 



DEVELOPMENT OF PERFORMANCE MEASURES 
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Ab performance tests for each subject area were developed, they 
were reviewed by the appropriate instructional department of the 
Armor School, the training brigade and battalion personnel for 
accuracy of the behavioral measures, appropriateness of time limits, 
feasibility of test conditions, and appropriateness of each task 
for inclusion in the program of instruction. 

Mid-cycle diagnostic examinations and end-of-cycle criterion 
examinations were prepared by selecting tests from those that had 
been developed by the working group and which were feasible for 
administration within resource capabilities. Critical task per- 
formance measures were included in these selected tests. 

REVISION AND REFINEMENT OF PROGRAMS 

This extensive phase was conducted in late FY 74 and early 
FY 75. To ensure that training would be performance-oriented, all 
lesson plans for both AIT programs were reviewed in detail and, 
where appropriate, revised in accordance with performance training 
principles specified by TRADOC Pam 600-11. This was a time- 
consuming activity requiring close interaction among HumRBO and 
training center personnel. Throughout, lesson plans were revised 
as follows. 

All instruction was recast so as to be functional and job-task 
relevant. Attempts were made to break the large-group, lock-step 
mode of instruction by conducting instruction in the smallest groups 
that instructor density would permit, and by providing individual- 
ized instruction on the iiK>re difficult skills. Verbal presentations 
by instructors were sharply curtailed and the balance of class time 
was devoted to "hands-on" practice by the trainees toward attain- 
ment of the GO/NO-GO standards specified by the performance tests. 
Practice sessions were designed to include close interaction with 
instructors so that both trainees and instructors would be given 
frequent feedback on the progress being made toward achieving the 
performance standards. Provision was made for faster learners to 
assist the slower learners. 

Field Test of Reconnaissance Specialist Program (MOS IID) 

Field test of the new Reconnaissance Specialist Program began 
in May 1974. Continuous program revision continued through, and was 
based upon the findings of the training cycles for ten training 
troops (approximately 1,000 trainees). These activities are des- 
cribed below. 

Class observations and student interviews . PlumRRO personnel 
monitored all classes, and informally interviewed trainees during 
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the training cycles. Any specific problems in the instructional 
process were noted. For example, trainees would discuss problems 
they encountered, such as lack of readily available training aids, 
too little or too much practice time, inadequate demonstrations, 
too much lecturing, being rushed through training, and so on. 

Results of class observations and student interviews were 
discussed in weekly meetings with the squadron and troop commanders. 
These discussions led directly to appropriate changes in the lesson 
plans and training schedule before succeeding troops entered train- 
ing. 

Administration of examinations > The first attempt to adminis- 
ter the mid-cycle examination suffered administrative problems, 
e.g. 3 trainee flow from station to station was interrupted, too 
much time was wasted in waiting, instructors did not understand how 
to administer certain performance measures, and items of necessary 
equipment were unavailable. These problems were resolved and appro- 
priate refinements were made in testing procedures. Testers were 
trained in the revised procedures and were ready to administer tests 
to the second and succeeding troops. 

After testing procedures had "shaken down" in the first two 
cycles, numbers of "GOs" and "NO-GOs" on first test and retest were 
tabulated routinely for each performance measure. As successive 
troops proceeded through the system, these data were examined to 
determine which performance measures were presenting difficulties 
to the trainees, and what training refinements were required. 

Similar difficulties were encountered in initial administration 
of the end-of-cycle performance examination. Here, too, examination 
of data led directly to the solution of test administration problems 
and to the refinement of instructional techniques as successive 
troops proceeded through training. 

Mid-cycle and end-of-cycle performance examination data were 
collected on a total of ten training troops. 

Attitude questionnaires . Following end-of-cycle examinations, 
questionnaires were administered to trainees and instructors to 
determine their perceptions of the developing training program. 
These questionnaires were administered solely to supplement the 
other information being gathered upon which program refinement and 
problem solution were to be based. Attitude development and assess- 
ment were not being studied in the formal sense. 



Questionnaires used to sanq)le trainee and instructor reactions 
to the performance-oriented programs are contained iu the Appendix. 
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Field Test of Armor Crewman Program (MOS HE) 



Developmental Work Preceding Field Test * Performance measures 
were pilot-tested by administering them to trainees who had received 
the appropriate related instruction during training under the con- 
ventional program. Twenty-four performance measures could not be so 
evaluated because instruction in these tasks was not being offered 
as part of the conventional Program of Instruction (POI) . Tank 
commanders, drill instructors, subject-matter experts and HumREW) 
personnel reviewed the pilot-tested measures, and appropriate 
changes in conditions and standards were made. 

All lesson plans were reviewed in detail and re-written by 
personnel of the two training battalions and the POI committee. 
Several review-rewrite loops involving brigade, HumllRO, and 
battalion training personnel eventually resulted in a complete set 
of revised lesson plans for field test. 

Field test of the new Armor Crewman Program began in July 1974. 
As with the IID program, revision continued through, and was based 
upon the findings of, the training cycles for 14 Armor training 
companies (approximately 2,000 trainees). Following is a descrip- 
tion of these activities. 

Class observations . As was the case in the IID program, nx)ni- 
toring of classes over time identified areas of instruction needing 
further attention. For example, instructors tended to lecture 
trainees and unnecessarily extend demonstrations, even though 
practical exercises were available to provide practice on the train- 
ing tasks. In such specific cases, guidance was provided on how to 
reduce demonstration time and begin trainee practice earlier in the 
class period. 

Many such refinements were made over the course of the field 

test. 

Administration of examinations . The mid-cycle examination 
presented no problems in administration in that it had been pilot- 
tested prior to field test use. 

The new end-of-cycle examination could not be included in the 
field test with the first four con5)anies to go through the program. 
A major administrative problem occurred in that the new examination 
procedures required that no instructors from the company being 
tested would be used as testers of their own trainees. Requests for 
testers from other companies could not be met and compromise was 
eventually attained by using testers from the POI Committee, brigade 
maintenace pool, and some from the con5)any being tested. 
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As a result » the earliest end--of-cycle performance data avail- 
able were obtained from the fifth company. Data on trainee per- 
formance from the sixth, seventh, and eighth companies were exam- 
ined to determine where initial refinement in the training program 
was necessary. 

After the fifth company, only spot checks of mid-cycle exami- 
nation data were found to be required. End-of-cycle examination 
data for all subsequent companies were reviewed to determine where 
further changes were necessary. 

Attitude questionnaires . After their end-of-cycle examinations 
trainees from the first three companies were administered the same 
questionnaire that had been administered to the llD program trainees 
Instructors of the first and third companies also responded to the 
questionnaire which had been administered to the llD instructors. 



RESULTS AND DISCUSSION OF ALL PHASES 



TASK INVENTORIES, TRAINING OBJECTIVES AND PERFORMANCE TESTS 

In the IID course, 235 job-tasks were identified in the lesson 
plans, and 20 others were identified by the working group as poten- 
tially desirable. Further analysis reduced the total of 255 to 101 
for inclusion in the training program. 

In the llE course, 225 tasks were identified in the lesson 
plans, and 17 others not in the lesson plans were identified e.s 
desirable. Further analysis reduced the total of 242 to 106 for 
inclusion in the training program. 

These task lists for llD and llE, together with their assigned 
proficiency levels are reported in a HumRRO Consulting Report. 

Many of the tasks were found to be compound, consisting of two 
or more related tasks. For example, the llD task, "Enter /leave 
radio net," is actually two tasks — one for entering and one for 
leaving. The HE task, "Fire the main gxan," actually consists of 
16 related tasks, each requiring a separate objective statement. 
These tasks were separated before training objectives were prepared. 
Analysis led to the development of 151 training objectives for llD 
and 195 for llE. 

When training objectives were translated into performance 
measures, and grouped into tests by subject, the total numbers of 
performance tests that emerged were 52 for llD and 63 for HE. 
Tables 1 and 2 summarize the distributions of tasks, objectives and 
tests. These training objectives and tests, including conditions 
and standards, are reported in two HumRRD Consulting Reports. ^ 



G. Gary Boy can and William L. Warnick. Training Requirements 
for the Armor Crewman and Reconnaissance Specialist Advanced Indi-- 
Vidual Training Programs^ Consulting Report, Human Resources Research 
Organization, November 1972. 

^J. Patrick Ford, James H. Harris, and Peter F. Rondiac. Per- 
fonmnce Measures for AIT Armor Creb)man^ Consulting Report, Human 
Resources Research Organization, April 1974. 

James H. Harris, J. Patrick Ford, and B. B. Bell, III. Per- 
formance Measures for AIT Reconnaissance Specialistj Consulting 
Report, Human Resources Research Organization, April 1974. 
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TABLE 1. DISTRIBUTION OF llE TASK INVENTORIES, 
TRAINING OBJECTIVES, PERFORMANCE MEASURES, AND 
TESTS BY MOS SUBJECT 



MOS SUBJECT 



Task Inventory Training Performance 
Original Final Objectives Measures Tests 



Maintenance 

Services 41 13 15 15 6 

Driving 33 17 32 27 6 

Connnunications 22 7 20 17 5 

Weapons 39 33 52 35 14 

Gunnery 81 36 76 72 32 
Tactical 

Training 26 0 0 0 0 

Total 242 106 195 166 63 
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TABLE 2. DISTRIBUTION OF llD TASK INVENTORIES, 
TRAINING OBJECTIVES, PERFORMANCE MEASURES, AND 
TESTS BY MOS SUBJECT 



Task Inventory Training Performance 
Original Final Objectives Measures Tests 



C ommuni ca t io ns 


27 


8 


19 


19 


6 


Driving and 
Maintenance 
S{,rvices 


56 


23 


35 


28 


11 


Map Reading/ 
Land 

Navigation 


13 


20 


23 


19 


10 


Demolitions 


35 


5 


5 


5 


3 


Individual 
Weapons 


12 


0 


0 


0 


0 


Automatic 
Weapons 


52 


29 


46 


45 


12 


Tactical 
Training 


46 


14 


21 


21 


9 


Indirect Fire 


14 


2 


2 


2 


1 


Total 


255 


101 


151 


139 


52 
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Ravltftd Army Subject Schedulee 17-llElO and 17-11D10» Including 
tht new performance tests were eent to IRADOC In January 1974 • 
TRADOC approved the ASubJScde for uee In the eubeequent field teete. 

FIELD TEST OF IID PROGRAM 

11 D Examination Data 

General trende In the data and eelected examplee of how f Ind- 
Inge were used to eolve program problems are preeented In thle 
eectlon. Summary troop performance data are preeented In Table 3 
and Figure 1» Not all performance meaeures were admlnletered In 
both examinations. The blank eectlone of Table 3 reflect this. Mid- 
cycle data were eliminated for the f Iret troop becauee of the admln- 
letratlve probleme noted above. 

On the early mid-cycle teete » "tranemlttlng a meeeage" wae one 
of the two moet difficult performance meaeuree (eee Table 3) • 
Tralneee either forgot to Identify themselvee or forgot to uee the 
phonetic alphabet to epell abbrevlatlone. The flret troop experi- 
enced the same problems on their end-of-*cycle teet. Lesson plans 
for the communications classss wsre overhauled to Include: (1) 
practice by the tralneee with frequent feedback to them, (2) a two- 
hour practical exerclee In the third week ae a review, and (3) uee 
of communlcatlone proceduree In tactical training and Indirect fire 
requester Thess and similar changss contrlbutsd to Incrsassd 
proflclsflcy by the fourth through tenth troope on the communlcatlone 
performance meaeuree on both the mid-cycle and end-of-cycle examina- 
tions (sss Tabls 3} . 

Anothsr sxampls of a difficult mld-cycls psrformancs msasurs 
for ths tralnsss of sarly troops was "filling out OA Form 2408-1.*' 
Ths solution was to altsr class procsdurs to snsurs that sach 
trainee practiced filling out thle form and DA Form 2404. The uee 
of leee Important forms was only dsmonstratsd» and ths tlms saved 
wae added to the practice time for Forms 2408-1 and 2404. Con- 
tlnusd smphasls In training on thess forms » glvsn to all troops i 
rssultrd In thslr sxscutlng ths forms satisfactorily during thslr 
snd-of-cycls sxamlnatlons (again, sss Tabls 3). 

Map rsadlng psrformancs meaeuree were alec demonetrated to be 
difficult for the early troope on the mid-cycle teet. Becauee map 
reading Inetructlon had been dropped from Baelc Combat Training at 
eome training centere, approximately half of the tralneee had not 
been trained In thle ekUl. Therefore, tralneee who had prevlouely 
acquired map reading ekUle, or who developed them rapidly, eerved 
ae peer Instructors for othsr tralnsss. A carsful rsvlsw of 
Instructional matsrlals dlsclossd handouts that wars hard to read; 
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TABLE 3. IID FIRST TEST "GO" BATES ON PERFORMANCE 
MEASURES OF MID-CYCLE AND END-OF-CYCLE EXAMINATIONS 

BY MOS SUBJECT 



MOS Subject: Mid-Cycle of Troops End-of -Cycle of Troopt; 

Performance Measure 2,3,4 5,6,7,8,9,10 1,2,3,4 5,6,7,8,9,10 

Communications : 



Into operation 


.79 


.90 


.91 


.97 


Enter net 


.87 


.95 






Radio Check 






.81 


.93 


Transmit message 


.44 


.87 


.80 


.94 


Record message 






.91 


.96 


Leave net 


.88 


.98 







Driving and 
Maintenance Services: 

Starting M151 .96 .94 

Driving M151 .94 .90 

Stopping M151 .95 .96 

DA Form 2404 .84 .87 .95 1.00 

Operator's manual .82 .97 

Lubrication order .93 .99 

Before operations 

checks .89 1.00 

After operations 

checks .92 1.00 

DA Form 2408-1 .60 .82 .96 .97 

Map Reading: 

Military symbols .57 .62 

Terrain features .51 .55 

Plotting .68 .72 

Road distance .44 .54 

Demolitions: 

Electrical .94 .98 

Non-electrical .94 .98 

Automatic Weapons: 

Clear M60 .87 .86 .83 .93 

Disassemble M60 .93 .97 .94 .99 

Assemble M60 .67 .75 .78 .96 
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MOS Subject: Mid-Cycle of Troops End -of -Cycle of Troops 

Performance Measure 2,3,4 5,6,7,8,9,10 1,2,3,4 5,6,7,8,9,10 

Tactical Training: 

Bridge report .89 .97 

Tracking .77 .92 

Indirect Fire 
Request: 

Visual search .98 1.00 

Spot report .96 1.00 

Initial request .95 .99 

Subsequent request .94 1.00 
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this may have accounted for poor learning. These materials were 
redrawn prior to their subsequent use. 

An example of a relatively simple problem to remedy, was 
found during the first troop's end-of-cycle test. Over half of the 
trainees were NO-GO in "tracking." The cadreman who conducted the 
tracking test found that trainees could not judge the age of tracks. 
This finding led to a minor modification in the tracking lesson 
plan which stressed estimating age of imprints. 

Two weeks after the first troop's end-of -cycle test, mid-cycle 
data from the third troop and end-of-cycle data from the second 
troop were available. Proportion of first-time GOs was greater for 
the third than the second troop's mid-cycle test. They had less 
trouble transmitting a message, filling out EA Form 2408-1 and 
using the operator's manual, all tasks which had been difficult for 
the second troop. GO rates were not much greater on the map reading 
performance measures, but it was found that over three-quarters of 
the NO-GO trainees became GOs when retested following critique of 
their performance. 

Overall end-of-cycle performance of the second troop was found 
to be somewhat better than that of the first troop. The GO rate on 
"tracking" and "transmitting a message" had improved considerably. 
Performance improvements probably reflected more in-class "testing" 
in the second troop which had been introduced to provide feedback. 

As noted earlier, mid-cycle diagnostic examinations of the 
earlier troops clearly indicated major difficulties in the training 
program. The first column in Table 3 indicates where problems 
occurred. The remaining column of mid-cycle and both columns of 
end-of-cycle examination scores reflect the cumulative effect of 
corrective revisions in the program. 

Generally, the impact of training revisions was substantial 
as reflected by the differences between the earlier and later mid- 
cycle scores (columns 1 and 2 in Table 3). Test performance in- 
creases on successive end-of-cycle examinations were smaller com- 
pared to those on the mid-cycle tests because early troops regis- 
tered high end-of-cycle GO rates. Consequently, there was less 
requirement for improvement (columns 3 and 4, Table 3). 

Overall troop percent GO first-test scores for each of the 10 
troops are plotted in Figure 1. The progressive improvement in both 
mid-cycle and end-of-cycle performance over the course of the field 
test is clear. Mid-cycle performance began at about 60 percent and 
increased to about 90 percent. End-of-cycle performance began at 
about 80 percent and leveled off close to the maximum. 
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IID Attitude Questionnaire Results 

Responses to the questionnfiire by MOS llD trainees were 
generally favorable throughout the course of the field test. They 
liked "hands-on" training and were confident in their ability to 
perforin. They reported that explanations and demonstrations were 
clear and that the level and length of explanation was about right. 
In the area of skill practice they indicated that instructors pro- 
vided good coaching, that sometimes trainees provided peer instruc- 
tion, and that more practice time was usually provided for trainees 
who needed it. Trainees also perceived the performance tests to be 
valid indicators of their proficiency. Responses to questions on 
self -pacing were neutral. Overall, the training program was 
evaluated favorably by the trainees. 

When asked to compare the revised program with the convention- 
al program, many early troop instructors indicated that they worked 
harder, that their motivation and morale were lower, and that more 
t4niA was wasted in the new program. These initial negative atti- 
tudes probably reflected the difficulties attending the initiation 
of the new program. Instructors did ha*ve to work hard to write 
and implement new lesson plans; frequent instructional changes were 
frustrating; and, incomplete and incorrect lesson plans added to the 
frustration and led to wasted time. 

Other early troop instructors thought trainees learned more in 
the revised program than they did in the conventional program. They 
reported their own motivation and morale were about the same, that 
less not more time was wasted, and that use of resources was more 
efficient. However, all instructors agreed that they worked harder 
in the revised program. 

Over the course of the field test, as the system "shook down" 
admixiistratively, and as trainee performance steadily improved, 
cadre attitudes also became more positive. 

FIELD TEST OF HE PROGRAM 

HE Examination Data 

General trends in the data and one example of how findings were 
used to define program problems are presented in this section. Sum- 
mary company performance data are presented in Table 4 and Figure 2. 
As was the case in the llD program, not all performance measures were 
administered in both the mid- and end-of-cycle examination. The 
blank sections of Table 4 reflect this. No end-of-cycle data could 
be collected for the first four training companies as noted above. 
Mid-cycle data are missing for companies 6, 7, and 12 because 
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unanticipated operational problems (scheduling, weather, overrid- 
ing priorities) curtailed testing time, modified test conditions, 
or otherwise contaminated the scores. 

The data clearly show tliat overall the HE program proved to 
be much less in need of refinement than did the llD program. 
Early cycles performed almost as well as did the later cycles on 
the mid --cycle examination. Early cycles performed as well as, or 
even somewhat better than, the later cycles on the end-of-cycle 
examination. Thus, the progressive improvement exhibited by the 
llE training troops did not occur over the course of the HE field 
test. Training companies started out performing well and continued 
to do so. This is taken to reflect the intensive preparations made 
jointly by HumRRD and ATC personnel to perfect training and testing 
techniques immediately prior to initiating the HE field test. 

HE Attitude Questionnaire Results 

The responses of HE companies were even more favorable to 
their training than were those of the llD troops. They enjoyed 
''hands-on" training, were quite confident in their proficiency, and 
indicated that they thought almost all tests were valid indicators 
of that proficiency. Though they found the demonstrations and 
explanations to be clear, they noted that instructors tended to 
talk too much. Trainees indicated that they usually had enough 
practice time, that instructors provided coaching during practice, 
and allowed peer instruction. Additional practice time was made 
available to trainees who needed it. Pace of instruction seemed to 
be open to question. Sizeable numbers of trainees indicated that 
they were tested or checked out before they were ready, but that 
faster or slower learners were allowed, more likely than not, to 
proceed through the course at their own rate. 

When asked to compare the new program with the conventional 
program, first and third company instructors indicated that they 
worked harder, that their motivation and morale were lower, and 
that more time was wasted in the revised program. Based on these 
indicators and on instructor complaints that the week of instruc- 
tion devoted to driving required too many overtime hours, the driv- 
ing and maintenance parts of the mid-cycle examination were inte- 
grated with driving instruction. 

Both groups of instructors indicated that trainees learned 
more in the new program. Trainee and instructor attitude data 
collected after the end-of-cycle examinations did not identify any 
additional problems that had not already surfaced in their comments 
during training or in the performance tests. 
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FINDINGS AND REFLECTIONS 



The requirement to undertake the activities reported here 
under the conditions imposed was a prodigious one. Personnel tixrn- 
over and higher priority duties at the Arnor Center were a source 
of frustration and resulted in frequent delays in accomplishing 
the first three phases. The requirement to convert these two 
programs during the course of ongoing training operations without 
obstructing training presented insoluble problems of research 
design, experimental control and project management. The training 
brigade* s mission of providing an uninterrupted stream of MOS 
qualified llD and llE graduates had to take precedence, and it did. 
Time and time again, troop and company comnanders * decisions made 
in the execution of their myriad responsibilities required com- 
promise of R&D needs. 

Over tinte, the two programs did come about, albeit with a 
wide turning radius. The hoped-for instituting of performance- 
oriented training techniques progressed as: (1) training and test- 
ing techniques were defined, (2) standards for performance became 
more firmly understood and established, and (3) performance, 
observations, and attitude data were fed back into the programs 
indicating areas where further attention was needed. Happily, most 
of this was accomplished for the llE program before the field test 
was launched. 

Performance test and observational data, in addition to 
reflecting improved system functioning from cycle-to-cycle, 
indicated that, generally, the performance-based techniques were 
producing llD and llE graduates with high levels of skill over a 
range of critical tasks. Trainee and cadre attitudes reflected 
confidence in the same. The two programs were cost/effective in 
that these high skill levels were achieved with no increase in 
training base cadre, facility, or time costs. 

As other studies conducted in operational settings have shown, 
the accomplishing of institutional change is time-consuming and 
difficult in a large training center. This is so for a number of 
reasons: (1) the training load is heavy, (2) ongoing operational 
training activities have precedence and must not be interrupted, 

(3) demands on the time of training staff are already heavy, and 

(4) turnover among training personnel is high. When such condi- 
tions prevail quick conversion to new instructional techniques can- 
not be expected. Rather, conversion occurs over extended periods 
of time in a somewhat incremental fashion. Further, close monitor- 
ing of the system undergoing revision must be maintained to assure 
that planned innovations are incorporated, and that once incorporated 
they do not "wash out," 
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APPENDIX 



Questionnaires Used to Sample Trainee and Instructor 
Attitudes Toward the Performance -Oriented Programs 
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IID AND HE TRAINEE QUESTIONNAIRE 



ERIC 



MME_ 

Last First MI 

Social Security No. Unit 



Check one answer for each question which is closest to the way you 
feel about the course. 

1. Did the instructor explain clearly what you were expected to 
learn in his class? 

All the time 

M ost of the time 
Some of the time 



_A few times 
None of the time 



2. How many of the demonstrations clearly showed what you were 
supposed to learn? 

All 



_Most 
_Some 
_Few 
None 



3. How much talking did the instructor do before you were allowed 
to perform the task? 

Far too much 



^Slightly too much 
_About right 
[^Slightly too little 
Far too little 



4. Did you usually have enough practice time 

Yes 

No 



7 



9^ ^?^13 



5. How often did an instructor assist you when you needed help 
during practice? 



Always 

Usually 

Sometimes 

Seldom or never 

I never needed help 

6. How often were you tested or checked out before you were ready? 

N ever 

Seldom 

^Sometimes 

Often 

A lways 

7. How many times did you help others learn a task? 

M any times 

A few times 

N ever 

8* How often were students given more time to practice when they 
needed it? 

A lways 

Usually 

Sometimes 

^Seldom 

N ever 

9. How many of the performance tests really checked what you were 
supposed to learn? 

All 

Most 

^Some 

^Few 

N one 

10. How often were the faster or slower learners allowed to mave 
through the course at their own rate? 

A lways 

Usually 

Sometimes 

R arely 
^Never 



ERIC 



34^4 



11. How well do you like this type of training? 

like it a lot 

like it somewhat 

neither like it nor dislike it 

dislike it somewhat 

I dislike it a lot 

12. What two things did you like most about this type of training? 
1. 



2. 



13. What two things did you dislike about this type of training? 
1. 



2. 



14. How many of the tasks which you learned do you think you 
perform well? 

All 

M any 

Some 

^Few 

None 
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IID AND HE AIT INSTRUCTOR QUESTIONNAIRE 



In the following statements, please check the one answer which 
±8 closest to the way you feel or is closest to the correct infor- 
mation. This information will not be analyzed individually; there- 
fore, please answer all questions truthfully. 

1. How does the New Program compare with the Older Program as to 
the aioount of material students actually learn? 

Students learn much more in the New Program 

Students learn a little more in the New Program 

Students learn about the same amount in both programs 

Students learn a little less in the New Program 

Students learn much less in the New Program 

2. How does the New Program compare with the Older Program as to 
motivation and morale of students? 

Student motivation and morale are much higher in the New Program 

Student motivation and morale are a little higher in the New 

Program 

Student motivation and morale are about the same in both programs 

Student motivation and morale are a little lower in the New 

Program 

Student motivation and morale are much lower in the New Program 

3. How does the New Program compare with the Older Program as to 
work load of the CADRE/NCOs? 

The CADRE/NCO*s work is much heavier in the New Program 

The CADRE/NCO*s work load is a little heavier in the New Program 

The CADRE/NCO*s work load is about the same in both programs 

The CADRE/NCO*s work load is a little lighter in the New Program 
The CADRE/NCO*s work load is much lighter in the New Program 

4. How does the New Program compare with the Older Program as to 
the motivation and morale of CADRE/NCOs? 

CADRE/NCO*s motivation and morale are much higher in the New 

Program 

CADRE/NCO's motivation and morale are a little higher in the New 

Program 

CADRE/NCO's motivation and morale are about the same in both 
programs 

CADRE/NCO's motivation and morale are a little lower in the New 

Program 

CADRE/ NCO 's motivation and morale are much lower in the New Program 



37 



ERLC 



5. How does the New Program compare with the Older Program as to 
the amount of time that Is wasted? 

Far more time Is wasted In the New Program 

A little more time Is wasted In the New Program 

About the same amount of time Is wasted In both programs 

A little less time Is wasted In the New Program 

Far less time Is wasted In the New Program 

Please explain: 



6. How does the New Program compare with the Older Program as to 
the efficient use of equipment and other resources? 

The New Program Is far more efficient 

The New Program Is a little more efficient 

They are about equally efficient 

The Nes/ Program Is a little less efficient 

The New Program Is far less efficient 



7- If I were In an Amnor unit In the 
field, I would be happy to have any 
USATCA graduate assigned to my 
platoon. 



Agree completely 
Agree moderately 
Undecided 

Disagree moderately 
Disagree completely 



8. Most of what Is taught In USATCA 
Is need-to-know Information. 



9. Once a trainee has passed a test» 
he should be used to help another 
trainee who Is having trouble. 



10. Trainees get little benefit by 
helping each other to learn. 



Agree completely 
Agree moderately 
Undecided 

Disagree moderately 
Disagree completely 

Agree completely 
Agree moderately 
Undecided 

Disagree moderately 
Disagree completely 

Agree completely 
Agree moderately 
Undecided 

Disagree moderately 
Disagree completely 
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11. Trainees should not be allowed to 
go on and learn a new skill in 
the course until they have master 
ed the one they are working on. 



12. The standards for passing tests 
are too high and should be 
lowered so that more trainees 
can qualify. 



Agree completely 
Agree moderately 
Undecided 

Disagree moderately 
Disagree completely 

Agree completely 
Agree moderately 
Undecided 

Disagree moderately 
Disagree completely 



ERIC 
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